Real-time Dtw-based Gesture Recognition External Object for Max/msp and Puredata
نویسندگان
چکیده
This paper focuses on a real-time Max/MSP implementation of a gesture recognition tool based on Dynamic Time Warping (DTW). We present an original ”multi-grid” DTW algorithm, that does not require prior segmentation. The num.dtw object will be downloadable on the numediart website both for Max/MSP and for Pure Data. Though this research was conducted in the framework described below, with wearable sensors, we believe it could be useful in many other contexts. We are for instance starting a new project where we will evaluate our DTW object on video tracking data as well as on a combination of video tracking and wearable sensors data.
منابع مشابه
Composability for Musical Gesture Signal Processing using new OSC-based Object and Functional Programming Extensions to Max/MSP
An effective programming style for gesture signal processing is described using a new library that brings efficient run-time polymorphism, functional and instance-based object-oriented programming to Max/MSP. By introducing better support for generic programming and composability Max/MSP becomes a more productive environment for managing the growing scale and complexity of gesture sensing syste...
متن کاملImplementation of the Discrete Hidden Markov Model in Max/MSP Environment
A set of discrete Hidden Markov Model (HMM) objects have been developed for Max/MSP software as part of the project that deals with the analysis of expressive movements of a conductor. The objects were tested with recognition of English alphabet symbols, and were applied toward analysis of isolated conducting gestures. Training and recognition procedures were applied toward both right hand beat...
متن کاملChaotic Signal Synthesis with Real-time Control: Solving Differential Equations in Pd, Max/msp, and Jmax
Chaotic signals are useful in two different levels in audio synthesis: as sound material or control structure. Patching languages such as Pd, Max/MSP, and jMAX provide easier mechanisms for generating chaotic structures at control level. We can generate deterministic chaotic signals either by finding numerical solutions to differential equations or by using first return maps. While generating t...
متن کاملHand Gestures Classification with Multi-Core DTW
Classifications of several gesture types are very helpful in several applications. This paper tries to address fast classifications of hand gestures using DTW over multi-core simple processors. We presented a methodology to distribute templates over multi-cores and then allow parallel execution of the classification. The results were presented to voting algorithm in which the majority vote was ...
متن کاملProbability-Based Dynamic Time Warping for Gesture Recognition on RGB-D Data
Dynamic Time Warping (DTW) is commonly used in gesture recognition tasks in order to tackle the temporal length variability of gestures. In the DTW framework, a set of gesture patterns are compared one by one to a maybe infinite test sequence, and a query gesture category is recognized if a warping cost inferior to a given value is found within the test sequence. Nevertheless, either taking one...
متن کامل